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A 


Abstract 

Manufacturing  fault  diagnosis  is  the  problem  of  determining  the 
manufacturing  fault(s)  responsible  for  any  critical  dimensions  or 
performance  tests  of  the  final  assembly  that  fall  outside  their 
tolerance  limits,  as  measured  by  on-line  probes  inserted  at  several 
chosen  points  of  the  assembly.   An  effective  means  for  manufacturing 
fault  diagnosis  is  crucial  for  controlling  the  quality  of  products 
rolling  out  of  the  manufacturing  system.   The  current  practice  of  this 
fault  diagnosis  process  is  to  employ  a  computer-based  information 
system  to  monitor  the  in-line  testing  results  and  have  a  diagnostic 
expert  interpret  the  data  when  problematic  measurements  or  perform- 
ances are  observed,  so  that  any  aberrations  of  the  manufacturing 
system  can  be  corrected.  However,  such  an  approach  usually  creates 
information  overload  and  production-line  disruptions,  making  the 
diagnostic  task  burdensome  and  prone  to  judgmental  errors. 

The  objective  of  this  research  is  to  automate  the  diagnostic  proc- 
ess by  an  artificial  intelligence  (AI)  approach.   The  approach  is 
characterized  as  qualitative  reasoning;  it  makes  diagnostic  decisions 
by  "explaining"  the  undesirable  test  measurements  and  building  causal 
links  based  on  the  qualitative  model  of  the  product  assembly.  We 
illustrate  the  fault-diagnosis  approach  by  studying  the  quality 
management  of  a  torque-converter  system  at  a  Caterpillar  plant. 
Empirical  manufacturing  data  is  used  to  illustrate  the  procedure  for 
validating  the  model. 
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1«   Introduction 

Manufacturing  fault  diagnosis  is  an  integral  part  of  the  quality 
control  process  which  ensures  that  product  assemblies  rolling  out  of 
the  shop-floor  meet  design  and  performance  standards.   Even  though 
individual  parts  that  go  into  an  assembly  are  subjected  to  in-line 
quality  control  and  testing  during  the  manufacturing  process,  perform- 
ance testing  on  the  final  assembly  is  still  required  to  ensure  that 
the  components  are  put  together  properly  and  that  the  final  assembly 
meets  the  design  specifications  (Garvin  [1988]). 

Fault  diagnosis  in  a  mechanical  assembly  is  constrained  by  the 
fact  that  relatively  few  components  comprising  the  assembly  are  ame- 
nable to  performance  monitoring,  since  most  of  the  assembly  is  en- 
closed in  some  sort  of  housing,  rendering  the  enclosed  components 
inaccessible.   Measurement  probes  are  inserted  at  several  chosen 
points  which  are  accessible,  and  performance  of  the  assembly  is  deemed 
satisfactory  if  the  measurements  recorded  by  these  probes  fall  within 
specified  tolerance  limits.  When  an  observed  test  parameter  falls 
outside  its  tolerance  limits,  the  observation  is  treated  as  a  "symptom" 
of  the  possible  manufacturing  fault.   The  goal  of  the  fault-diagnosis 
problem  is  to  determine  the  faults  responsible  for  a  set  of  symptoms 
observed,  so  that  any  abberations  of  the  manufacturing  system  that 
cause  the  faults  can  be  detected  and  corrected  as  soon  as  possible 
(Groover  [1980],  Ranky  [1986]). 

The  current  practice  of  this  fault  diagnosis  process  in  the  manu- 
facturing industry  is  to  employ  a  computer-based  information  system  to 
monitor  the  in-line  testing  results  and  have  an  expert  make  diagnostic 
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decisions  when  undesirable  measurements  are  found.   In  manufacturing 
systems  producing  a  large  volume  of  the  final  assembly,  such  an 
approach  may  create  information  overload,  making  the  diagnostic  task 
burdensome  and  prone  to  errors. 

This  paper  describes  an  artificial  intelligence  method  for  auto- 
mating manufacturing  fault  diagnosis.   The  major  task  of  this  method 
is  to  reason  from  behavior  to  structure.  That  is,  given  testing 
results  observed  from  measurement  probes,  the  method  is  aimed  at 
determining  the  structural  defect(s)  responsible  for  the  abnormal 
testing  results. 

The  diagnostic  method  is  characterized  as  qualitative  reasoning 
because  it  reasons  and  explains  the  behavior  of  mechanical  assemblies 
in  qualitative  terms,  without  invoking  the  mathematics  of  continuously 
varying  quantities  and  differential  equations  in  modeling  the  dynamic 
processes  linking  the  faults  to  the  symptoms.   It  can  produce  causal 
accounts  of  the  underlying  physical  mechanisms  within  the  assembly, 
thus  providing  an  effective  diagnostic  tool. 

The  qualitative  reasoning  approach  is  based  on  a  deep  reasoning 
model;   it  incorporates  a  structural  description  of  the  mechanical 
assembly.   By  contrast,  expert  systems  incorporating  only  shallow 
models  make  decisions  directly  from  observed  features  of  the  presented 
situations  without  an  understanding  of  the  underlying  structure.   In 
performing  manufacturing  fault  diagnosis,  reasoning  with  deep  models 
has  these  advantages:   (1)  The  diagnosis  system  with  deep  models  is 
capable  of  dealing  with  novel  faults.   Expert  systems  with  shallow 
models  can  only  handle  anticipated  faults  with  the  heuristics 


Table  1  Comparisons  Between  Expert  Systems  for  Manufacturing  Fault 
Diagnosis  Using  Qualitative  Reasoning  ("Deep  Model")  and 
Expert  Systems  with  "Shallow  Model." 
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incorporated;  deep  reasoning  models  explicitly  represent  the  whole 
scope  of  the  system  under  study,  thus  capable  of  reasoning  with  every 
type  of  problem  scenario,  including  those  not  encountered  before. 
(2)  The  diagnosis  system  with  deep  models  is  easier  to  migrate  from 
one  manufacturer  environment  to  another  without  the  need  for  a  major 
modification.   This  is  possible  because  of  the  separation  of  the 
causal  model — the  structural  and  behavioral  descriptions  of  the 
assembly — and  the  diagnostic  process.   (3)  It  is  easier  to  maintain 
since  any  changes  in  the  design  of  the  assembly  can  be  made  by  simply 
modifying  the  structural  description;  by  contrast,  systems  with 
shallow  models  need  to  re-examine  all  the  diagnostic  heuristics  to 
accommodate  the  changes.   (4)  The  diagnostic  process  can  be  more  effi- 
cient when  deep  reasoning  models  are  used  because  the  system  can  use 
causal  propogation  to  save  the  searching  time.   Finally,  (5)  it  is 
easier  to  validate  the  completeness  and  correctness  of  the  diagnosis 
system  with  deep  models  because  of  the  modular  representation  of  the 
structural  and  behavioral  descriptions  (Table  1). 


Insert  Table  1  Here 


The  remaining  part  of  this  paper  is  organized  as  follows:   Section 
2  defines  the  qualitative  reasoning  approach  to  manufacturing  fault 
diagnosis,  introducing  the  step-by-step  procedure;  Section  3  describes 
the  torque-converter  system  as  an  example,  formulating  the  qualitative 
causal  model  for  the  torque-converter  assemblies;  in  Section  4,  the 
qualitative  process  is  applied  to  a  diagnostic  example;  finally,  Sec- 
tion 5  shows  an  empirical  validation  procedure  using  inductive  learning 
to  generate  diagnostic  rules  from  testing  data. 
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2.  A  Qualitative  Reasoning  Approach  to  Manufacturing  Fault  Diagnosis 
2.1  Qualitative  Physics 

The  study  on  qualitative  reasoning  to  problem  solving  originated 
from  the  AT  research  work  on  qualitative  physics  (de  Kleer  and  Brown, 
[1985]),  which  aims  at  formalizing  the  commonse  knowledge  about  the 
everyday  physical  world.  This  branch  of  AI  is  motivated  by  the  human's 
ability  to  use  intuition  to  reason  about  common  physical  processes 
without  intensive  mathematical  calculations  (Larkin  et  al.  [1980]). 
By  the  same  token,  the  researchers  reasoned,  it  would  be  handy  if  an 
intelligent  system  could  be  equipped  with  the  same  type  of  capability 
for  understanding  physical  processes.   The  understanding  may  be  just 
qualitative,  not  as  sophisticated  as  the  solutions  obtained  from 
intensive  calculations  based  on  laws  of  physics.   But  the  important 
point  is  that  through  such  qualitative  reasoning  the  intelligent 
system  can  obtain  a  useful  estimation  of  the  behavior  of  the  physical 
process  under  study  with  relatively  simple  computation  or  reasoning. 
Such  qualitative  reasoning  capability  has  been  pointed  out  as  an 
important  design  for  the  next  generation  of  expert  systems  (Bobrow 
[1985]). 

The  concept  of  "paths  of  causal  interaction"  is  central  to  reason- 
ing from  structure  and  behavior  of  a  physical  system  (Kuiper  [1985], 
Iwasaki  and  Simon  [1985]).   Thus  an  effect  that  originates  at  some 
location  in  a  device  is  transmitted  through  one  or  more  paths  of 
causal  interaction,  possibly  undergoing  a  change  of  form  in  the  proc- 
ess, before  manifesting  itself  as  a  different  effect  at  some  other 
(physically  or  functionally  removed)  location. 
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The  qualitative  reasoning  approaches  developed  to  date  have  all 
assumed  compos itlonality;   the  system  under  study  is  broken  down  into 
components.   Each  component  has  certain  specified  behavior,  and  the 
behavior  of  the  system  as  a  whole  can  be  explained  by  the  component's 
behavior  characteristics  and  the  connections  between  the  components. 
That  is,  the  behavior  of  the  system  is  derivable  from  the  structure  of 
the  system.   A  physical  process  in  this  context  is  perceived  as  the 
aggregation  of  interactions  between  individual  components,  each  with 
its  own  distinct  behavior,  that  propagate  in  a  cause-and-ef feet  chain 
(Rieger  and  Grinsberg  [1978]). 

There  have  been  a  number  of  researchers  applying  qualitative 
reasoning  to  diagnostic  tasks,  mostly  on  electrical  circuit  analysis 
(Davis  [1985],  Genesereth  [1985],  de  Kleer  [1985]).   Our  approach  takes 
the  view  that  a  mechanical  device  or  a  manufacturing  assembly,  such  as 
a  torque  converter,  can  be  modeled  as  an  interconnection  of  "compo- 
nents" and  "conduits"  through  which  "materials"  flow.   The  corollary 
to  this  is  that  an  effect  originating  at  some  part  A  in  the  device 
cannot  manifest  as  an  effect  at  some  other  part  B  in  the  assembly  if 
there  is  no  connecting  path  of  interaction  between  A  and  B. 

Fault  diagnosis  thus  follows  a  causal  reasoning  process  which 
essentially  crosses  previously  built  cause-and-ef f ect  bridges  between 
the  various  parts  in  the  assembly  (Reiter  [1987]).   The  aggregate 
behavior  of  the  assembly  can  be  described  by  tracing  the  behavior  of 
individual  parts  through  the  cause-and-ef feet  bridges  or  paths  of 
causal  interaction.   Thus  by  observing  local  behavior  at  a  preselected 
set  of  points  in  the  assembly,  it  should  be  possible  to  make  reasonable 
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judgraents  of  how  the  assembly  as  a  whole  is  functioning.   If  the 
assembly  is  malfunctioning,  one  or  more  of  the  set  of  local  behaviors 
that  are  being  monitored  must  exhibit  behavior  that  is  symptomatic  of 
the  malfunction.   Having  detected  a  symptom  (deviation  from  norm  in 
local  behavior  at  one  or  more  of  the  preselected  points),  the  causal 
reasoning  process  takes  over,  tracing  the  symptom  back  to  the  source 
of  the  malfunction. 

Unlike  fault  diagnosis  in  electrical  circuits  where  testing  of  the 
output  of  individual  components  is  possible  even  after  they  are  as- 
sembled into  the  circuit  (on  a  board),  mechanical  assemblies  typically 
do  not  permit  such  unlimited  component  access,  being  enclosed  in  a 
housing  that  renders  these  components  invisible  to  the  outside.   The 
behavior  of  individual  components  can  therefore  only  be  inferred  from 
observing  the  overall  behavior  of  the  assembly  (which  is  a  set  of 
measurements  obtained  from  probes  inserted  at  select  accessible  points 
in  the  assembly),  and  knowledge  of  the  manner  in  which  individual  com- 
ponents interact  with  each  other  to  influence  this  overall  behavior 
(Becker  and  Bartlett  [1988],  Fink  and  Lusth  [1987]). 

Our  approach  bases  the  structural  description  of  the  assembly  on 
the  notion  of  paths  of  causal  interaction  which  we  call  a  schematic. 
The  schematic  of  a  mechanical  assembly  is  a  network  representation  of 
the  interconnections  between  its  parts  (Murakami  and  Nakajima  [1988]). 
Similar  to  the  current  flow  in  an  electric  circuit,  one  or  more 
"materials"  such  as  fluid  (characterized  by  its  velocity  of  flow  or 
pressure),  a  force,  or  torque,  etc.  flow  through  the  elements  in  the 
schematic.   The  structure  of  an  individual  part  is  described  by  a  set 
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of  structural  variables  which  characterize  the  part,  i.e.,  how  they 
physically  affect  the  material  that  flows  through  the  part,  possibly 
causing  it  to  change  in  magnitude  or  form.   The  behavioral  description 
of  a  part  is  encoded  in  a  set  of  behavioral  rules  involving  its  struc- 
tural variables  and  the  material  flowing  through  it.   These  rules 
specify  how  the  mapping  of  input  material  to  output  takes  place  for 
various  qualitative  values  of  the  structural  variables.   A  step-by- 
step  approach  to  building  the  requisite  qualitative  reasoning  frame- 
work for  manufacturing  fault  diagnosis  is  given  below. 

2.2   Building  the  Qualitative  Reasoning  Framework 

The  qualitative  reasoning  approach  to  fault  diagnosis  entails  the 
following: 

i)  identifying  a  list  of  elements  (parts)  in  the  assembly  that 
play  a  functional  role  in  determining  overall  behavior; 
ii)  categorizing  these  elements  as  Components  if  they  change  the 
form  or  magnitude  of  the  material  flowing  through  them,  or  as 
Conduits  if  they  simply  transfer  material  between  Components 
without  changing  any  of  its  characteristics; 
iii)  identifying  the  structural  variables  set  for  each  element  in 
(i)  and  their  qualitative  mappings.   These  are  qualitative 
variables  that  can  assume  one  of  a  usually  small  set  of 
qualitative  values.   Each  qualitative  value  represents  a  dis- 
joint interval  on  the  real  line  in  that  variable's  quan- 
titative space.   Thus  if  the  "normal"  range  (tolerance  limits 
specified  by  the  design)  for  a  clearance  between  two  adjacent 
parts  in  the  device  is  [.001"   .004"],  this  entire  interval 
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is  mapped  onto  a  single  value  in  qualitative  space  (Forbus 
[1985]),  say  [0].   Values  below  .001"  could  be  mapped  onto 
the  value  [-]  while  those  above  .004"  onto  the  value  [+] .   In 
this  way  the  entire  set  of  possible  values  for  this  clearance 
are  now  represented  by  three  qualitative  values,  [0],  [-]  and 

iv)  identifying  the  material(s)  flowing  through  each  element  in 
(i)  and  the  variable(s)  characterizing  this  flow; 
v)  linking  the  components  and  Conduits  in  (ii)  to  form  a  sche- 
matic that  depicts  the  material(s)  flow  through  the  assembly. 
Thus  two  elements  in  the  schematic  are  connected  (adjacent) 
only  if  they  have  a  common  material  flowing  from  one  to  the 
other,  i.e.,  the  variable  characterizing  this  flow  is  the 
same  for  both  elements.   This  constitutes  the  structural 
description  of  the  assembly; 

vi)  evolving  a  set  of  behavioral  rules  for  each  element  in  the 
schematic.   These  rules  are  cast  in  terras  of  the  element's 
structural  variables  set  and  the  variables  characterizing  the 
material  flowing  into  and  out  of  it.   Each  rule  describes  how 
input  material  is  transformed  to  output  by  that  element  for 
various  qualitative  value  combinations  of  the  structural  and 
material  flow  variables.  This  constitutes  the  behavioral 
description  for  each  element.   A  trace  of  the  transformations 
undergone  by  the  material(s)  flowing  through  the  different 
elements  in  the  schematic  constitutes  aggregate  behavior  of 
the  device. 
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Having  put  together  an  abstracted  qualitative  model  of  the  mechanical 
device  as  described  above,  we  now  show  how  such  a  qualitative  model 
can  aid  the  reasoning  process  for  manufacturing  fault  diagnosis. 

2»3  The  Qualitative  Reasoning  Process  for  Manufacturing  Fault  Diagnosis 

A  failure  in  the  functioning  of  a  manufacturing  assembly  can  mani- 
fest itself  either  as  erroneous  unexpected  observed  behavior  or  as  a 
complete  breakdown  in  function  where  no  response  to  input  is  observed. 
The  former  is  a  malfunction  failure  type,  which  is  more  frequent  and 
difficult  to  diagnose.   Our  concern  in  this  paper  is  with  addressing 
this  problem. 

The  qualitative  reasoning  process  takes  observed  assembly  testing 
behavior  (symptoms)  as  input  and  bases  the  diagnosis  on  this  observed 
behavior.   These  symptoms  are  the  data  recorded  by  measurement  probes 
inserted  at  accessible  points  in  the  assembly.   Since  these  probes 
obtain  a  measure  of  the  dynamic  state  of  the  assembly,  the  variables 
being  measured  are  those  that  characterize  material  flow  at  chosen 
points  in  the  assembly.  The  qualitative  causal  reasoning  process  for 
manufacturing  diagnosis,  summarized  in  Figure  1,  may  therefore  be 
stated  as: 
GIVEN 

(i)  Structural  knowledge  of  variables  that  characterize  the  ele- 
ments in  a  manufacturing  assembly  and  the  paths  of  material 
flow  between  these  elements  (paths  of  causal  interaction) 
described  by  a  network  of  interconnections  called  the  schema- 
tic; 

(ii)  Behavioral  knowledge  of  how  these  structural  variables 

interact  to  influence  the  transformation  of  incoming  material 
to  output,  for  each  element  in  the  assembly; 
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(iii)  Performance  measurements,  which  are  stated  by  qualitative 
variables  characterizing  material  flow  at  several  fixed 
points  in  the  assembly; 

DETERMINE 

(i)  A  set  of  qualitative  values  for  the  structural  variables  that 
is  consistent  with  observed  values  for  material  flow. 

(ii)  The  malfunctioning  component(s) . 

Insert  Figure  1  Here 


The  source  of  the  observed  malfunction  is  determined  by  searching  for 
the  element  (or  elements  if  more  than  one  is  involved)  whose  struc- 
tural variable(s)  are  assigned  qualitative  values  that  connote 
deviations  from  norm,  i.e.,  variables  which  have  a  [-]  or  [+]  value 
assigned  by  the  reasoning  process.   The  solution  to  the  qualitative 
causal  reasoning  problem  involves  an  envisionment  process  (de  Kleer 
and  Brown  [1982],  Forbus  [1985],  Kuipers  [1986])  in  which  a  qualita- 
tive simulation  of  the  behavior  of  the  device  is  carried  out  using  the 
behavioral  rules. 

This  envisionment  process  traces  the  changes  that  take  place  in 
material  flow  through  the  schematic.   As  an  example.  Figure  2  shows  a 
simple  graphic  representation  of  a  qualitative  reasoning  process,  in 
which  test  parameter  probes,  [Tl ,  T2 ,  T3 ,  T4 ,  T5]  =  [0,  -,  +,  +,  0], 
measure  the  qualitative  value  of  material  flow  at  certain  chosen 
points  in  the  assembly.   Using  these  qualitative  values  for  the  per- 
formance measurements  as  input,  the  reasoning  process  attempts  to 
inject  deviations  at  the  exit  of  one  or  more  components  which  will 
explain  the  observed  values  for  T1-T5  by  having  the  envisionment  pro- 
cess start  at  the  origin  of  a  deviation  and  end  up  predicting  values 


Tl 


T5 


T4 


Note:  Given   observed   values   for  test  parameters 

[Tl    T2   T3    T4    T5]  =  [  0    -    +    +    0], 
the  qualitative  reasoning  process  concludes   that 
Malfunction  Component  =   {   C2  ) 


T2 


T3 
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FIGURE  2    An  Example  of  the  Qualitative  Reasoning  Process 
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for  T1-T5  that  match  observed  values.  The  system  finds  that  a 
malfunction  in  component  C2  can  "explain"  the  observed  values  for  Tl, 
T2,  T3,  T4  and  T5  since  the  deviations  injected  at  the  exit  of  C2  pro- 
pagate as  shown  in  the  figure.   (Note  that  behavior  rules  are  omitted 
in  this  example.)   The  system  therefore  returns  |C2j  as  the  location 
of  malfunction  in  the  assembly.  More  detailed  description  of  the 
reasoning  process  and  causal  propagations  using  the  behavioral  rules 
will  be  presented  in  Sections  2.4  and  2.5. 


Insert  Figure  2  Here 


Owing  to  the  nature  of  the  diagnosis  problem  domain,  we  are 
interested  only  in  the  steady  state  behavior  of  the  assembly  and  do 
not  concern  ourselves  with  transient  states  that  the  assembly  may 
assume  in  its  transition  to  the  steady  state.   Thus  rates  of  change 
(first  derivatives)  of  material  flow  variables  do  not  enter  the  behav- 
ioral rules.   The  reasoning  process  is  concerned  with  finding  a  set 
of  exit  flow  deviations  (i.e.,  deviations  introduced  to  the  values  of 
flows  at  the  exit  of  a  set  of  components)  that  will  result  in  values 
for  the  test  parameters  consistent  with  what  is  observed.   The  set  of 
components  thus  found  (this  set  would  contain  one  or  more  elements  in 
it)  represent  the  source(s)  of  malfunction  observed.   Using  a  generate 
and  test  procedure,  the  reasoning  process  first  identifies  a  candidate 
list  of  components  which  may  be  responsible  for  the  observed  device 
behavior.   These  candidates  represent  alternate  hypotheses  which  are 
then  tested,  one  at  a  time,  using  the  envisionment  process.   A  descrip- 
tion of  how  hypotheses  are  generated  and  tested  follows. 
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2»4   Building  Dependency  Lists  and  Generating  Hypothesis 

Under  assumptions  of  normalcy,  if  all  structural  variables  have 
design  specified  values,  i.e.,  a  qualitative  value  of  [0]  in  our  nota- 
tion, then  it  must  be  true  that  all  material  flow  variables  also  have 
design  specified  values,  i.e.,  [0].   In  other  words,  if  all  elements 
in  the  assembly  meet  design  standards,  then  the  assembly  as  a  whole 
must  perform  to  the  standards  laid  down.   As  a  corollary  to  this,  if 
any  subset  of  material  flow  values  show  deviations  from  normal,  i.e., 
they  have  qualitative  values  of  [-]  or  [+] ,  then  this  must  have  been 
caused  by  (-]  or  [+]  values  for  structural  variables  of  one  or  more 
elements  in  the  assembly.   The  space  of  all  combinations  of  deviations 
possible  in  structural  variables  can  be  too  large  to  enumerate.   How- 
ever at  this  point  we  resort  to  a  heuristic  for  guidance  in  managing 
this  space,  viz.  the  single-cause-of-failure  hypothesis.   Since  most 
assembly  malfunctions  in  practice  are  caused  by  a  failure  in  one  ele- 
ment, it  is  not  unreasonable  to  make  this  assumption  at  the  start  of 
the  diagnosis  process.   If  no  single  element  is  found  to  be  consistent 
with  the  observed  material  flow  values  then  we  can  relax  this  assump- 
tion and  look  for  multiple  causes  of  malfunction. 

Using  the  "single-cause-of-failure"  hypothesis  as  the  basis,  the 
system  is  run  with  deviations  ([-]  or  [+] )  introduced  in  the  struc- 
tural variable  set  of  each  component/conduit,  one  at  a  time.   Rather 
than  introduce  deviations  in  all  structural  variables,  only  those  that 
have  been  known  to  go  wrong  are  considered.   For  each  such  run,  a  list 
of  test  parameters  (material  flow  variables)  which  have  their  values 
affected  (changed  from  [0]  to  [-]  or  [+])  is  compiled.  When  all 
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simulation  runs  are  completed,  separate  dependency  lists  are  created, 
two  for  each  test  parameter,  one  specifying  Components/Conduits  that 
resulted  in  changing  the  value  from  [0]  to  [+] ,  and  the  other  for  the 
[0]  to  [-]  change.   These  dependency  lists  constitute  overall  beha- 
vioral knowledge  about  the  assembly,  generated  by  chaining  through  the 
behavioral  rules  of  individual  elements.   The  purpose  of  generating 
and  storing  these  dependency  lists  is  to  minimize  repetitive  traversal 
along  paths  in  the  schematic  expected  to  be  used  frequently. 

Another  perhaps  more  efficient  use  of  these  lists  is  in  creating  a 
shortlist  of  elements  that  are  likely  candidates  for  source  of  assembly 
malfunction.   This  is  done  by  forming  a  list  of  those  elements  that 
are  common  to  all  dependency  lists  associated  with  observed  material 
flow  values.   Thus  for  example,  if  material  flow  variables  VI,  V3  and 
V4  are  observed  to  have  [-] ,  [+]  and  [+]  values  respectively  (all  other 
test  parameters  are  assumed  to  be  normal,  i.e.,  [0]),  the  dependency 
lists  corresponding  to  [-]  value  for  VI,  [+]  value  for  V3  and  [+]  value 
for  V4  are  retrieved  and  elements  common  to  all  these  three  lists  com- 
prise the  candidate  shortlist.   The  underlying  assumption  here  is  again 
the  single-cause-of-f ailure  hypothesis.   This  is  akin  to  the  candidate 
generation  procedure  described  in  Davis  1983. 

2.5  Envisionment 

Envisionment  is  the  process  of  predicting  overall  device  behavior 
(i.e.,  the  operational  performance  of  the  assembly)  by  propagating  a 
given  set  of  local  behaviors  through  the  schematic  with  the  help  of 
behavioral  rules.   Envisionment  is  the  system's  way  of  answering 
what-iF  questions  about  the  effect  of  the  state  of  a  component  (local 
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behavior)  on  the  overall  behavior  of  the  assembly.   Each  component  has 
a  normal  state  associated  with  it  which  in  structural  terms  implies 
that  all  the  structural  variables  characterizing  the  component  conform 
to  design  specifications.   If  however  one  or  more  of  these  structural 
variables  is  outside  tolerance  specifications,  the  value  of  the 
material  flow  at  the  exit  of  this  component  would  no  longer  conform  to 
design  specifications.   The  envisionment  process  traces  the  effect  of 
this  deviation  in  value  of  material  flow  by  chaining  through  the  be- 
havioral rules  of  components/conduits  that  lie  in  the  path  of  this 
material  flow  after  it  leaves  the  component.   In  a  sense,  the  envision- 
ment process  is  a  simulation  mechanism  which  help  envision  the  effects 
of  causal  propagation. 

For  each  candidate  element  in  the  list,  a  deviation  is  introduced 
in  the  material  flow  value  at  the  output  end  of  the  element  and  this 
effect  is  propagated  through  the  schematic  using  behavioral  rules.   By 
creating  a  deviation  in  the  material  flow  value  at  the  output  end,  we 
are  implicitly  making  the  assumption  that  the  candidate  element  is  the 
source  of  the  assembly  malfunction.   Propagation  via  behavioral  rules 
determines  a  predicted  value  set  for  the  material  flow  variables  (test 
parameters).   This  predicted  value  set  is  now  compared  with  the 
observed  value  set  (obtained  from  probes  inserted  into  a  real  physical 
device).   If  the  two  sets  match,  the  candidate  element  is  diagnosed  to 
be  the  source  of  the  assembly  malfunction.   If  the  two  sets  do  not 
match,  the  hypothesis  that  the  candidate  element  is  a  likely  source  of 
device  malfunction  is  rejected  and  the  envisionment  process  is 
repeated  with  the  next  candidate  in  the  shortlist. 
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Appendix  A  provides  a  summary  of  the  qualitative  causal  reasoning 
process  in  fault  diagnosis. 

3.   Fault  Diagnosis  for  a  Torque  Converter  System 
3.1  Quality  Management  in  the  Manufacturing  System 

We  use  a  manufacturing  quality  management  system  at  Caterpillar  Co. 
as  the  testing  ground  for  our  fault  diagnosis  approach.   Caterpillar's 
industrial  tractor  manufacturing  facilities  rely  on  a  computerized 
system  for  quality  control  and  testing — referred  to  as  the  quality 
management  system  (QMS) — that  keeps  track  of  in-line  test  data  for 
each  component  as  it  is  put  through  the  various  manufacturing  pro- 
cesses.  This  QMS  data  is  used  to  provide  feedback  for  process  control 
and  also  serves  as  a  historical  record  of  individual  component's 
quality  information. 

One  of  the  several  product  lines  monitored  by  QMS  is  the  Torque 
Convertor  (TC)  assembly,  which  is  part  of  the  tractor's  power  transmis- 
sion system.   The  function  of  a  TC  is  to  transmit  power,  from  the  trac- 
tor's engine  to  the  propeller  shaft  and  on  to  the  wheels,  at  varying 
output  torque  levels  to  match  load  requirements.  The  TC  thus  serves 
the  purpose  of  a  gearbox  in  conventional  automobile  transmissions.  A 
more  detailed  description  of  the  TC  is  contained  in  Appendix  B. 

An  effective  fault  diagnosis  method  for  better  quality  management 
of  the  TC  line  is  important  because  the  cost  of  correcting  faults  in 
an  assembled  TC  is  high,  in  terras  of  the  resources  required  to 
dismantle  and  put  together  the  more  than  60  parts  that  go  into  a  TC. 
Currently,  QMS  maintains  data  obtained  from  performance  tests  carried 
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FIGURE  4  The  Sample  Data  Curves  Displayed  by  QMS 


-16- 

out  on  TC  assemblies.   These  data  are  used  by  the  diagnostic  experts 
in  deciding  the  location  and  nature  of  faults  in  "failed"  TC's. 

QMS  can  provide  statistical  data  on  a  variety  of  tested  values 
such  as  torque  absorption  (input  torque),  stall  torque  ratio  (ratio  of 
input  torque  to  output  torque  at  stall),  and  efficiency  (output 
horsepower/input  horsepower)  for  torque  converters.  QMS  passes  or 
fails  torque  converters  based  on  established  maximum  or  minimum  values 
for  those  tested  values.   Currently  curves  and  data  are  reviewed  on  a 
regular  basis  to  determine  if  there  has  been  a  significant  shift  in 
the  data  from  the  established  nominal  curve.   If  the  shift  is  proved 
to  be  detrimental  to  the  use  of  the  torque  converter  then  the  problem 
area  must  be  determined  online.   This  is  the  fault-diagnosis  problem 
dealt  with  in  this  paper. 

Figures  3  and  4  show  examples  of  the  kinds  of  statistical  reports 
and  curves  generated  by  QMS  on  such  tested  parameters  as  Input  Torque 
and  Leak  (the  amount  of  fluid  escaping  the  main  fluid  circuit).   \iJhen 
a  significant  shift  in  the  data  is  detected,  the  line  operator  first 
makes  sure  it  is  not  a  measurement  error;  the  diagnostic  expert  is 
then  called  upon  to  pinpoint  the  source  of  the  malfunction  based  on 
the  test  data. 


Insert  Figures  3  &  4  Here 


This  diagnostic  process  can  be  improved  by  an  Al-based  expert 
system.   Instead  of  calling  upon  the  diagnostic  expert,  the  line 
operator  can  key  in  the  performance  data  of  the  problematic  assembly 
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and  then  through  a  sequence  of  question-and-answering  interactions — 
referred  to  as  the  consultation  process — the  expert  system  will  give 
diagnosis  about  the  likely  source  of  malfunction.  Appendix  C  shows 
the  examples  of  diagnoses  given  by  a  prototype  expert  system  we  have 
built  for  the  TC.   In  contrast  with  the  statistical  data  (Figures  3 
and  4)  currently  generated  by  QMS,  the  information  provided  by  such  a 
diagnostic  expert  system  clearly  has  much  less  room  for  errors  than 
the  current  QMS  does. 

The  qualitative  reasoning  approach  described  in  Section  2  is 
applied  to  incorporate  a  deep  model  in  the  expert  system.   This  re- 
quires building  a  qualitative  causal  model  that  includes  the  structure 
and  behavior  descriptions  of  the  torque  converter  assembly,  as 
explained  in  the  following. 


3.2   A  Qualitative  Causal  Model  for  the  Torque  Converter 

Ignoring  the  bolts,  washers  and  other  relatively  unimportant  items 
in  the  parts  list  that  accompanies  the  TC  sectional  view  (see  Figure 
B-1),  Figure  5  illustrates  the  schematic  showing  interconnections  be- 
tween these  elements  and  the  material(s)  flowing  through  the  schema- 
tic.  The  corresponding  parts  are  explained  in  Table  2. 


Insert  Table  2  and  Figure  5  about  here 

The  torque  convertor  is  characterized  by  a  complex  set  of  quanti- 
tative equations  (for  details  see  [Larew  1968])  specifying  fluid  flow 
velocities  at  the  entrance  and  exit  points  of  the  impeller,  turbine 
and  stator.   These  velocities  are  a  function  of  blade  angles,  clear- 
ances between  impeller,  turbine  and  stator,  the  cross-sectional  areas 
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of  flow  compartments  formed  by  the  vanes,  and  the  geometry  of  the  flow 
path  (radii  of  the  core  and  shell).   These  flow  velocities  determine 
how  much  input  torque  is  required  to  run  the  impeller  and  turbine  at  a 
fixed  speed  ratio  for  a  given  load  (output  torque  requirement). 

Standards  are  established  for  the  test  parameters  at  specific 
speed  ratios.   Thus  for  each  of  the  four  output  to  input  shaft  speed 
ratios — stall  (output  shaft  stationary),  90  percent,  75  percent  and  50 
percent — the  optimum  range  (min.  and  max.  values)  for  input  torque 
(IT),  output  torque  (OT) ,  torque  ratio  (TR) ,  input  flow  (IFLOW),  out- 
put flow  (OFLOW),  inlet  pressure  (IPSI),  outlet  pressure  (OPSI),  inlet 
temperature  (ITEMP),  outlet  temperature  (OTEMP),  and  leakage  (LEAK) 
are  known.  These  values  are  based  on  efficiency  and  other  performance 
considerations.   Note  that  each  of  these  test  parameters  is  a  variable 
characterizing  material  flow  in  the  TC  schematic. 

From  the  design  specifications  for  the  TC  geometry  (blade  angles, 
clearance  and  radii  of  core  and  shell),  the  desired  flow  velocities 
at  the  entrance  and  exit  points  of  our  three  main  Components  can  be 
determined  using  the  set  of  quantitative  equations.   This  gives  a 
complete  description  of  optima  for  all  variables  at  each  speed  ratio. 
Note  that  these  optima  are  really  ranges  of  values  (intervals)  that 
constitute  tolerance  limits. 

Next,  these  intervals  are  mapped  onto  their  qualitative  equivalents 
such  that  each  interval  is  mapped  onto  a  single  qualitative  value.   We 
use  three  qualitative  values  to  represent  the  entire  real  line  in  a 
variable's  quantitative  space. 
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Quantitative  Value 
[A  B]  =  interval  of  optimum  values 
values  <  A 
values  >  B 


Qualitative  Value 
[0] 
[-] 
[  +  ] 


1 


Fault  diagnosis  in  the  TC  involves  tracing  a  symptom  (deviation  in 
one  or  more  test  parameters)  back  to  a  Component  or  Conduit.  While  in 
principle,  the  diagnosis  should  be  able  to  trace  the  exact  location 
and  nature  of  the  fault  within  the  Component/Conduit,  this  is  imprac- 
tical in  a  manufacturing  scenario  for  productivity  reasons.   It  is 
much  cheaper  to  simply  replace  a  Component/Conduit  that  is  identified 
as  the  source  of  the  fault  than  to  rework  the  faulty  part  and  bring  it 
within  tolerance  limits.   Rework,  when  possible,  is  best  done  offline 
so  that  no  production  bottlenecks  are  created  (as  a  result  of  diverting 
production  resources  to  rework)  that  could  result  in  starving  down- 
stream manufacturing  operations  and  reducing  throughput.   The  excep- 
tion to  this  is  when  the  faulty  element  cannot  be  replaced,  as  for 
example,  in  the  case  of  the  fault  being  traced  to  a  clearance  (a 
Conduit  in  our  representation),  or  when  rework  is  easily  done,  as  is 
the  case  when  a  missing  washer  or  spacer  is  the  source  of  the  problem. 

Thus  an  intelligent  diagnostic  system  should  be  able  to  trace  a 
symptom  back  to  a  deviation  in  fluid  flow  velocity  (since  this  is  the 
main  material  type  in  the  physical  device)  at  the  entrance  or  exit  of 
some  Component/Conduit  in  the  schematic.  Whether  such  a  deviation  was 
caused  by  an  incorrect  blade  angle,  variation  in  cross-sectional  area 
or  surface  defects  on  the  blades  is  not  of  consequence  to  the  diagnosis 
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process.   This  has  the  effect  of  making  lesser  demands  on  the  diagnos- 
tic system  by  cutting  short  its  backtracking  process. 

Accordingly,  our  system  is  equipped  with  a  set  of  behavioral  rules 
that  specify  how  different  (qualitative)  values  of  entrance  velocity/ 
torque  into  a  Component/Conduit  are  transformed  to  exit  values, 
together  with  any  other  effects  this  may  have  on  observed  test  param- 
eters.  These  effects  on  test  parameters  are  those  that  occur  as  a 
direct  result  of  the  corresponding  Component/Conduit's  transformation 
process.   Thus  if  Component  A  causes  a  deviation  in  exit  fluid  flow 
velocity  which  in  turn  causes  Component  B  to  affect  a  test  parameter 
then  this  effect  will  be  described  in  Component  B's  rules  not  in  A's. 
This  preserves  the  spirit  of  the  principle  of  adjacency  (Davis  [1985]) 
by  allowing  elements  to  affect  only  their  neighbors  and  not  be  able  to 
act  at  a  distance  except  by  the  propogation  of  interaction  effects. 

Descriptions  of  Structure  and  Behavior 

For  each  Component/Conduit  in  the  TC  (see  Table  II),  the  structural 

variables  set  together  with  the  behavioral  rules  that  govern  mapping 

of  entrance  flow  velocity  and  entrance  torque  to  exit  flow  velocity 

and  exit  torque  are  given  below. 

Note;   Variables  that  do  not  appear  in  a  behavioral  rule  are  assumed 

to  have  a  value  of  [0],  i.e.,  normal. 

Input  shaft 

Variables 

T   =  input  torque  from  the  engine 

T   ^  .   =  torque  transmitted  from  input  shaft  to  housing  assembly 
out,  is      ^  *^ 
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T    ,  ,  =  torque  transmitted  from  bearing  Bl  to  input  shaft 
out,bl      ^  &         f 

V.   =  rpm  of  input  shaft 

Behavioral  Rules 

(1)  {T^  '   (+1)  and  {V^^  =  (+)}  >  {T^^^_^^  -  [*]) 

(2)  (T^  =  [-)}  and  (V^^  -  (-]} >  (T^^^^^^  =  [-)} 

Rule  (1)  and  (2)  specify  the  torque-speed  characteristics  of  the 
engine.   In  order  to  generate  a  higher  input  torque  T.  the  engine  must 
revolve  faster,  i.e.,  V,   (this  is  the  same  as  the  engine  rpm  since 
input  shaft  is  directly  coupled)  must  increase.   (Note  that  beyond  a 
certain  speed,  torque  put  out  by  the  engine  will  begin  to  drop.   For 
the  purposes  of  this  analysis  this  is  omitted.) 

Rule  (3)  says  that  if  the  bearing  is  "sticking"  and  thereby  trans- 
mitting some  torque  from  the  output  shaft,  this  gets  added  on  to  the 
input  torque  from  the  engine.   In  effect,  the  load  capacity  on  the 
output  shaft  decreases  because  of  this  dissipation. 

Housing  Assembly 

Variables 

T   ^  .   =  torque  transmitted  from  input  shaft  to  housing  assembly 
out, is       ^  ^  o  J 

T   ^  ,   =  torque  transmitted  from  housing  assembly  to  impeller 
out, ha      ^  Q  J  f 

V,   =  rpm  of  housing  assembly  (this  is  equal  to  V   ) 
Behavioral  Rules 


">  l^out.ha  =  '-'> >  i^out.is  -  '-'1 
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The  housing  assembly  merely  transmits  the  torque  received  by  it  from 
the  input  shaft.   None  of  its  own  variables  can  ever  change  this. 

Impeller 

Variables 

R.   ^  =  distance  from  axis  of  TC  at  impeller  entrance 
in,i  '^ 

R  ^  .  =  distance  from  axis  of  TC  at  impeller  exit 
outji  ^ 

V  =  radial  velocity  of  impeller  vanes  (rpm) 

T   ^  ,   =  torque  transmitted  from  housing  assembly  to  impeller 
out, ha      ^  b  J  f 

V.   ,  =  radial  velocity  of  fluid  at  impeller  entrance 
in,i  ■'  ^ 

V  ^  .  =  radial  velocity  of  fluid  at  impeller  exit 
out,i  •'  ^ 

Behavioral  Rules 

(1)  {V^„^,  =  [01)  >  {V^^^^^  =  (01)  and  (T^^^_^^  =  [01) 

(2)  (V^„_^  =  (-1)  >  {V^^^_^  =  101)  and  {T^^^^^^  =  1+1) 

(3)  {V^^^^  =  1=1)  >  {V^^^^^  =  101)  and  (T^^^^^^  =  (-1) 

(4)  v^  .  1-1  — ->  (v_^^^_^  -  1-11 

")  ^out.l  =  t^l >  IVt.l  =  1*1} 

Rules  (2)  and  (3)  have  the  entrance  variable  T  ^  ,   on  the  right-hand 

out, ha 

side  of  the  rule.   This  is  because  the  impeller  draws  input  torque 
depending  on  the  load  attached  to  the  output  shaft  and  thus  in  a  sense 
determines  how  much  torque  is  put  out  by  the  engine. 
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Clearance  Between  Impeller  and  Turbine  (CI) 

Variables 

V    .  =  radial  velocity  of  fluid  at  impeller  exit 
out.i  •'  '^ 


in 


=  radial  velocity  of  fluid  at  turbine  entrance 


C.   =  clearance  between  impeller  and  turbine 
Behavioral  Rules 

(2)  {C^^  =  l-l)    — ->  {V^^^^  =  [-1} 

Rule  (2)  says  that  too  low  a  clearance  results  in  reduction  of  entrance 
velocity  at  the  turbine  due  to  losses  caused  by  turbulence. 

Turbine 

Variables 

R.   ^  =  distance  from  axis  of  TC  at  turbine  entrace 
in,  t 

R  ^  ^  =  distance  from  axis  of  TC  at  turbine  exit 
out ,  t 

V.   ^  =  radial  velocity  of  fluid  at  turbine  entrace 
in,  t  ■' 

V  ^  ^  =  velocity  of  fluid  at  turbine  exit 
out,t  ^ 

V  =  radial  velocity  of  turbine  vanes  (rpm) 
m  =  blade  angle  at  turbine  entrance 

T  ^    ^   -   output  torque  transmitted  by  turbine  to  hub 
out,t       f       ^  J 


Behavioral  Rules 

(1)  {V^„^,  -  101}  - 

(2)  {V^„_^  =  (-1)  - 

<3)  i^in.t  =  '^11  - 
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(4)  {n,^  =  (  +  1} >  (T^^^^^  =  1-Jl  and  {V^  =  [-]} 


Hub 


Variables 


T   ^   =  output  torque  transmitted  by  turbine  to  hub 
out,t      f  ^ 

T   ^  ,  =  torque  transmitted  to  output  shaft 
out,h      ^  ^ 

Behavioral  Rules 

<1>  tT„,,,,  =  (01}  >  {T^„,_h  =  '°1} 

">  fT^ut.t  =  !-'> >  f^out.h  =  1-') 

»>  ^^out.t  =  '^D >  t^out.h  -  '^') 

Clearance  Between  Turbine  and  Stator  (C2) 

Variables 

V   ^   =  velocity  of  fluid  at  turbine  exit 
out,t  ■' 

V.     =  radial  velocity  of  fluid  at  stator  entrance 
in,st  "^ 

C^   =  clearance  between  turbine  and  stator 
ts 

Behavioral  Rules 

(2)  tc^^  =  [-)}    >  {V^_^_^^  .  [-,} 

»)  {^ut.t  -  I-l> >  f^n.st  -  '-'> 

<^)  l^ut.t  =  I^n  — ->  (^in.st  '   '^'1 

Stator 

Variables 

V.    ^  =  radial  velocity  of  fluid  at  stator  entrance 
in,st  -^ 

V 


ou 


t  St  ~  velocity  of  fluid  at  stator  exit 
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T       =  torque  transmitted  to  stator  shaft 
out, St 

n   =  blade  angle  at  stator  exit 


Behavioral  Rules 

(1)  {V,    ^  =  [0]}  >  {V   ^   ^  =  [0]}  and  {T  ^   ^  =  [0]} 

"•  in, St      ••       '■  out, St      •"      *•  out, St      •' 

(2)  {V,    ^  =  [-]}  >  {V   ^   ^  =  [-]}  and  {T  ^   ^  =  [-]} 

"■  in, St      ■'       "■  out, St      '  "•  out, St      ■' 

(3)  {V,    ^  =  [+]}  >  {V   ^   ^  =  [+]}  and  {T   ,   ,  =  [+]} 

I  in, St      '  I  out, St      >  I  out, St   '■    ^i 

W    |n  ,  =  [+]}  >  (V   ^   ^  =  [-]}  and  (T   ,   ,  =  [-]} 

I  St      J        I  out, St      J      I  out, St      J 

Clearance  Between  Stator  and  Impeller  (C3) 

Variables 

V       =  velocity  of  fluid  at  stator  exit 
out, St 

V.   .  =  radial  velocity  of  fluid  at  impeller  entrance 
in,i  -'  *^ 

C  .  =  clearance  between  stator  and  impeller 

si  ^ 

Behavioral  Rules 

(1)  {V  ^   ^  =  [0]}  - 
^  out, St       * 

(2)  {C^^  =  (-]} 

">  t^ut.st  =  '-»  - 
<*>  (Vt.st  =  '^1}  - 

Stator  Shaft 

Variables 

T   ^   ^  =  torque  transmitted  to  stator  shaft 
out,st      ^ 

T   ^   .  =  reaction  torque  transmitted  to  stator 
out, si  ^ 

T   ^   ^  =  torque  transmitted  to  bearing  B2 
out,s2      ^  ^ 


> 

^^in,i  = 

[0]} 

> 

^^n,i  = 

I-]} 

> 

<^in,i  = 

[-]} 

> 

^in,i 

M} 
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Behavioral   Rules 

(1)    {Truest  '   '-!>    — ->   tT„,,,,i  =   l-U 
<2>    (^out.st  -   l^'l   — ->   f^out.sl  =    '">} 

Bearing  B2  (Between  Stator  Shaft  and  Output  Shaft) 

Variables 

TEMP, ^  =  temperature  of  bearing 

T     „  =  torque  transmitted  to  bearing  B2 
out,s2      ^ 

T    ,  r,  =  torque  transmitted  to  output  shaft 
out,b2      ^ 

Behavioral  Rules 

(1)  {TEMP^2  '    '°'>  >  fTout.b2  =  I°'> 

(2)  {TEMP^2  =  '^1> >  <^out,b2  =  ^*^'> 

If  the  bearing  gets  overheated  it  implies  that  it  is  not  running 
freely  and  thereby  transmitting  some  torque  to  output  shaft. 

Output  Shaft 

Variables 

T    ,  =  torque  transmitted  to  output  shaft 
out,h      ^  *^ 

T  ^  , o  =  torque  transmitted  to  output  shaft 
out,b2      ^  *^ 

T  ^   ,  =  torque  transmitted  to  bearing  Bl 
out,osl      ^  ^ 

T  ^   <,  =  torque  transmitted  to  load 
out,os2      ^ 

Behavioral  Rules 

<2>  tT^ut.h  =  l-'J   >  l^out,os2  =  '-!> 
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<5)  tT,„,,„,,  '  [*]} >  {I„,,,„32  =■  (-)} 

Rule  (4)  says  that  when  bearing  B2  transmits  torque  from  the  stator 

shaft  it  has  the  effect  of  reducing  the  torque  from  the  output  shaft 

since  the  stator  shaft  is  applying  a  torque  in  the  opposite  direction. 

Rule  (5)  says  that  if  bearing  Bl  is  "sticking"  and  thereby  drawing 

some  torque  (T      .),  the  net  torque  available  to  drive  the  attached 
^     oat,osl  ^ 

load  (T   ^   ^)  will  decrease  as  a  result  of  this  dissipation. 
out,os2  ^ 

Bearing  Bl  (Between  Output  Shaft  and  Input  Shaft) 

Varialbles 

T  ^   ,  =  torque  transmitted  to  bearing  Bl 

OUtjOSl        ^  ^ 

T    ,  ,  =  torque  transmitted  to  input  shaft 
out,bl      ^  *^ 

TEMP.  ,  =  temperature  of  bearing 

Behavioral  Rules 

(1)  {TEMP^^  =  [01}  >  {T^^^^^^  -  [01}  and  {T^^.^^^^  =  [01) 

(2)  (TEHP^^  =  [  +  1} >  (I^^^^^^  =  [  +  1}  and  {T,^,^^^,  =  [^D 

Rule  (2)  says  that  if  the  bearing  does  not  run  smoothly  (gets  over- 
heated), it  draws  torque  (T      ,)  from  the  output  shaft  and  trans- 
*  ^     out,osl  ^ 

mits  this  back  to  the  input  shaft  (T  ^  ,,)• 

*^  out,bl 


This  completes  the  qualitative  causal  model  building  stage  for  the 


TC. 


4.   An  Example  of  the  Qualitative  Reasoning  Process 

When  a  TC  fails  on  the  testbed,  the  observed  values  for  the  test 

parameters  together  with  the  input  values  for  torque  T.  ,  speed  V 

i         Is 


-28- 

(input  shaft  rpm) ,  and  speed  V   (turbine  rpm)  are  read  off  the  gauges 

on  the  testbed.   The  system  first  retrieves  the  dependency  lists  for 

each  test  parameter  that  has  a  [+]  or  [-]  value  and  finds  those 

components/conduits  that  are  common  to  all  these  dependency  lists. 

This  corresponds  to  (i)  and  (ii)  of  Hypothesis  Generation  (Step  2)  in 

the  Qualitative  Reasoning  Process  (see  Appendix  A).   Note  that  the 

Dependency  Lists  are  assumed  to  already  exist  so  the  system  skips 

Step  1. 

For  the  purposes  of  this  example,  let  us  assume  that  the  output 

torque  T   ^    ^  put  out  by  the  output  shaft  is  below  the  tolerance 
^    out,os2  ^  ■>  ^ 

range,  i.e.,  it  has  a  value  of  [-].   All  other  test  parameters  have 
normal  values,  i.e.,  [0]. 

The  diagnostic  system  initializes  the  qualitative  model  of  the  TC 
by  setting  the  output  torque  (OT)  test  parameter  value  to  [-] ,  and  all 
other  test  parameter  values  to  [0].   The  system  first  retrieves  the 
dependency  list  of  components/conduits  that  could  cause  a  [-]  value 
for  the  OT  test  parameter.   Only  one  dependency  list  is  retrieved 
because  only  one  test  parameter  deviation  was  observed.   The  depen- 
dency list  corresponding  to  a  [-]  value  for  the  OT  component  (in  terms 

of  the  schematic  what  this  really  means  is  that  T      ^  =  [-])  is 

■'  out,os2 

{B2,  CI},  say.   (There  may  be  other  components/conduits  in  this  list 
but  for  the  purposes  of  illustrating  the  qualitative  reasoning  mechan- 
ism in  operation  we  consider  the  two  most  common  causes  of  failure 
associated  with  this  symptom.)   The  system  now  proceeds  to  examine 
each  of  these  in  turn,  in  an  attempt  at  uncovering  more  corroborative 
evidence  with  the  help  of  the  behavioral  rules. 
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Following  (i)  of  Step  3  of  the  Qualitative  Reasoning  Process,  B2 
is  made  the  current  hypothesis  (location  of  fault)  and  the  system  finds 
that  rule  (2)  of  bearing  B2  maps  a  problem  in  the  bearing  (overheating) 
to  a  deviation  in  the  value  of  torque  transmitted  by  the  bearing  (nor- 
mally no  torque  is  transmitted)  to  the  output  shaft: 

(2)  {TEMP^2  =  t*'>  >  f^out,b2  "  '*'>• 

Propogating  this  deviation  forward  through  the  network,  it  determines 

that  this  leads  to  a  deviation  in  torque  transmitted  from  the  output 

shaft: 

^  out,b2      ^  ^    out,os2      •• 

Since  no  other  test  parameter  deviation  was  concluded  in  this  pro- 

pogation  process,  B2  overheating  is  consistent  with  all  other  test 
parameters  having  a  [0]  value.   The  system  therefore  puts  B2  in  a 
confirmed  list  and  sets  CI  as  the  new  current  hypothesis.   (Repetition 
of  (i)  of  Step  3  of  the  QR  process  with  the  second  element  in  the  can- 
didate list.) 

Rule  (2)  of  CI  is  used  as  the  starting  point  of  the  propogation: 

(2)  {C^^  -  [-]}  >  {V^„^^  «  [-1). 

Then  rule  (2)  of  the  Turbine  asserts: 

(2)  {V^„^^  .  [-1)  >  {V^^^^^  -  ;-l)  and  {T^^^^^  =  [-]) . 

Since  this  rule  describes  two  deviations  a  branching  occurs  in  the 
propogaton  process.   Following  the  second  conjunct  of  the  RHS  of  the 
above  rule  through  rule  (2)  of  the  Hub  and  rule  (2)  of  the  Output 
Shaft,  the  system  asserts: 

(2>  (T^ut.c  =  '-)> >  f^out.h  =  111>  ^"<^ 

<2)  {T„„,.h  =  [-1} >  {^out.os2  =  '-!>• 
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This  branch  of  the  propagation  process  is  thus  consistent  with 
observed  data.   However  when  the  first  conjunct  is  propogated  forward 
thorugh  rule  (3)  of  C2  and  rule  (2)  of  Stator  the  system  asserts: 

<2)  {V,„^3,  -  (-1}  >  {V„^^_^^  =  [-])  and  {T^^^_^^  =  [-1). 

Following  the  branching  along  the  first  conjunct  and  propagating 

through  rule  (3)  of  C3  and  rule  (2)  of  Impeller  the  system  asserts: 

(3)  {V   ^   ^  =  [-]}  >  {V    .  =  [-]}  and 

^  out,st  in,i 

(2)  {V.   .  =  [-]}  >  {V   ^  ^  =  [0]}  and  {T  ^    ,=    [+]}. 

^  in,i  out,i      ■'        out, ha 

But  if  {T    ^   =  [+]}  then  {T     ,   =  [+]}  as  specified  by  rule  (3) 
"■  out, ha  out, is 

of  Housing  Assembly: 

»>  f^out.ha  =  1^1>  — ->  f^out.ls  =  l^'l 

Note  that  since  Housing  Assembly  is  a  conduit,  it  merely  transfers 

its  input  material  as  output  without  altering  its  value.   The  input 
and  output  variables  are  strictly  equal. 

By  a  similar  argument,  rule  (1)  of  Input  Shaft  asserts: 

(1)  {Tj  =  t  +  1} >  {I„„,_j3  =  M)   and  {V.^  =  (  +  )}. 

Thus  it  must  be  true  that  {T  =  [+]}.   But  this  contradicts  the 
observed  value  for  input  torque  which  is  normal,  i.e.,  {T.  =  [0]}.   At 
this  point  the  system  rejects  the  hypothesis  since  one  conjunct  of  an 
assertion  is  found  to  be  led  to  a  contradiction.   Note  that  the  reason- 
ing process  terminates  with  one  propagation  path  still  unexplored. 
The  final  diagnosis  of  location  of  fault  is  thus  determined  to  be  B2 
since  it  is  the  only  candidate  in  the  confirmed  list  ((ii)  of  Step  3). 
In  the  event  of  more  than  one  candidate  making  the  confirmed  list,  the 
system  resorts  to  the  expert's  judgemental  heuristics  and  returns  the 
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FIGURE  6  The  Causal  Explanation  for  a  Fault  Diagnosis  Example 
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mosC  likely  candidate  from  the  confirmed  list.   Figure  6  summarizes 
the  causal  explanation  as  a  result  of  the  qualitative  reasoning  pro- 
cess for  this  example. 


Insert  Figure  6  about  here 


A  prototype  of  this  system  is  implemented  on  a  TI  Explorer  machine 
using  the  KEE  (Knowledge  Engineering  Environment)  expert  system  shell. 
Each  component,  conduit  and  test  parameter  is  represented  as  a  frame 
with  slots  for  the  variables  that  characterize  it.   The  behavioral 
rules  are  stored  as  a  method  in  another  slot.   This  method  looks  at 
the  value  of  the  entrance  fluid  velocity/torque  and  computes  the  exit 
fluid  velocity/torque,  putting  this  value  in  the  appropriate  slot  and 
passing  a  message  (exit  velocity/torque  value)  to  the  adjacent  frame 
(as  specified  in  the  schematic).   The  name  of  the  adjacent  frame  is 
also  included  in  a  slot  in  this  frame.   Figure  7  shows  some  sample 
frames  for  "component"  part  types. 


Insert  Figure  7  Here 


In  the  frame-based  system,  a  simulation  run  of  the  TC  is  achieved 
by  message  passing  between  component  and  conduit  frames.   Given  an 
impeller  velocity,  input  torque,  and  speed  ratio  combination  as  input, 
the  system  completes  one  run  in  which  it  puts  entrance  and  exit 
velocity/torque  values  in  the  component  and  conduit  frames  and  the 
value  of  each  test  parameter  in  its  frame. 
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FIGURE  7  Sample  Frames  for  the  Schematic  Representation 
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FIGURE  7  Sample  Frames  for  the  Schematic  Representation 
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5«   Empirical  Validation  By  Inductive  Learning 

Given  a  product  assembly,  the  qualitative  causal  model  is  used  to 
capture  the  desired  structure  and  behavior  of  the  assembly.   The  quali- 
tative reasoning  process  can  propagate  the  effects  among  components 
and  derive  the  diagnosis  for  manufacturing  faults  based  on  the  observed 
aberrations — i.e.,  symptoms.   However,  this  qualitative  model  needs  to 
be  properly  validated  in  order  to  ensure  its  correctness  as  well  as 
the  effectiveness  of  the  diagnostic  process  based  on  the  model.   The 
problem  of  validation  is  to  ascertain  that  a  particular  qualitative 
model  demonstrates  a  composite  behavior  matching  the  behavior  of  the 
system  under  study  and  the  diagnostic  reasoning  process  performed  by 
the  expert. 

To  achieve  such  validation  for  the  qualitative  causal  model  of  the 
torque  convertor,  we  developed  a  procedure  using  the  manufacturing 
test  data  such  as  those  collected  from  Caterpillar's  torque-convertor 
Quality  Management  System.   Each  of  these  cases  was  classified  by 
detected  location  of  malfunction  (obtained  from  QMS  records). 

Putting  the  tested  data  cases  corresponding  to  problematic  torque 
converter  and  the  diagnosis  given  by  the  expert  together,  we  have  a 
set  of  data  case  in  the  following  form: 


rtest  data  for  the  x  v  ^detected  locationv 

problematic  torque  converter        of  malfunction 


These  data  cases  gathered  from  the  outputs  of  QMs  are  shown  in  Figure 
8.   The  basic  idea  of  the  validation  process  is  to  derive  rules  that 
can  link  a  subset  of  the  13  test  parameters  to  each  location  of  mal- 
function.  These  rules  are  then  tested  against  the  qualitative  causal 


« 


FIGURE  8  Test  Data  Used  as  the  Training  Examples 

SNO  TC  IRPH  ORPH  IT  OT  TR  IPSI  OPSI  IFLOW  OFLOW  LEAK  ITEMP  OTEMP  CLPSI  CLEAK  CLASS  LOCATION  OF  FAULT 

1  594  1701   1  784  1615  2.06   69  39  35.8  30.8  5  178  254  0  0  Al  CARRIER 

1  2  624  1701   1  774  1588  2.05   67  37  35.2  30.4  4.8  178  260  0  0  Al  CARRIER 

3  631  1701   0  797  1641  2.06   69  39  36.3  31.9  4.4  179  265  0  0  Al  CARRIER 

4  680  1701   1  784  1598  2.04   65  38  35.8  31.4  4.4  177  261  0  0  Al  CARRIER 

5  798  1701   2  794  1629  2.05   66  38  35.8  31.4  4.4  180  258  0  0  Al  CARRIER 

6  803  1701   1  797  1638  2.06   65  39  35.8  30.4  5.4  178  260  0  0  Al  CARRIER 

7  804  1701   1  764  1564  2.05  56  37  35.8  28.9  6.9  178  258  0  0  Al  CARRIER 

8  805  1701   1  785  1607  2.05  59  39  35.2  30.3  4.9  177  260  0  0  Al  CARRIER 

9  810  1701   1  771  1570  2.04  57  38  36.3  30.4  5.9  178  258  0  0  Al  CARRIER 

10  813  1699   1  775  1582  2.04  57  38  35.8  31.4  4.4  179  259  0  0  Al  CARRIER 

11  828  1701   1  777  1585  2.04  58  39  35.8  27.4  8.4  179  257  0  0  Al  CARRIER 

12  830  1699   1  785  1614  2.06  61  40  35.8  31.4  4.4  180  261  0  0  Al  CARRIER 

13  857  1701   1  787  1624  2.06  61  40  35.8  29.8  6  166  247  0  0  Al  CARRIER 

14  1142  1701   0  772  1580  2.05  60  38  35.8  30.4  5.4  179  256  0  0  Al  CARRIER 

15  5748  2001   1  680  1455  2.14  84  38  50.9  45.7  5.2  179  234  0  0  Al  CARRIER 

16  5859  2000   1  673  1453  2.16  86  38  50.9  45.7  5.2  180  240  0  0  Al  CARRIER 

17  5872  2001   1  670  1442  2.15  85  39  50.9  46.1  4.8  178  237  0  0  Al  CARRIER 

18  5904  2001   1  668  1454  2.18  88  39  50.9  46.1  4.8  179  242  0  0  Al  CARRIER 

19  5905  2001   1  665  1445  2.17  88  39  50.9  46.1  4.8  180  244  0  0  Al  CARRIER 

20  5923  2001   0  675  1448  2.15  85  37  50.9  46.2  4.7  180  239  0  0  Al  CARRIER 
1214058  1402  1404  1005  987  0.98  103  59  60.1  57.9  2.9  178  179  187  2.2  Al'  CARRIER  ASSEMBLY 

22  4141  1404  1405  997  979  0.98  106  61  60.1  57.9  2.6  179  180  185  1.4  Al'  CARRIER  ASSEMBLY 

23  4286  1400  1400  1005  986  0.98  106  59  60.5  58.4  2.5  180  181  188  1.4  Al'  CARRIER  ASSEMBLY 

24  5767  2001   0  772  1545  2  85  38  49.8  46.6  3.2  177  241  0  0  A2  IMPELLER 

.25  5821  2000   1  693  1456  2.1  86  39  50.4  48.2  2.2  179  238  0  0  A2  IMPELLER 

I 

126  5938  1999   1  693  1432  2.07  73  39  40.3  37.2  3.1  179  251  0  0  A2  IMPELLER 


FIGURE  8  Test  Data  Used  as  the  Training  Examples  (Continued) 

55  78  2100   0  697  1491  2.14  76  40  40.8  38.1  2.7  180  254  0  0  Bl  CLITTCH 

27  63  1401  1401  501  489  0.98  81  42  40.3  40.3  0.7  180  183  283  2.1  Bl  SHAFT 

28  67  1401  1400  496  501  1.01  80  41  40.8  39.8  1.7  180  187  281  2.3  Bl  SHAFT 
.29  69  1401  1399  492  501  1.02  80  41  40.3  40.2  0.9  179  183  282  2.4  Bl  SHAFT 

30  96  1401  1401  503  493  0.98  78  41  39.7  39.2  1.2  182  185  284  2.1  Bl  SHAFT 

31  97  1401  1399  500  505  1.01  78  41  40.3  39.3  1.7  182  184  279  2.1  Bl  SHAFT 

32  4277  1400  1401  1001  979  0.98  106  59  59.9  57.7  2.7  180  179  187  1.7  Bl'  HUB 

33  4278  1402  1403  1003  984  0.98  106  59  59.8  58.8  1.4  180  180  186  1.4  Bl'  HUB 

34  4286  1400  1400  1005  986  0.98  106  59  60.5  58.4  2.5  180  181  188  1.4  Bl'  HUB 

35  4368  1402  1402  1003  983  0.98  100  60  60.4  58.6  2.3  180  180  189  1.5  Bl'  HUB 

36  4381  1403  1403  1005  984  0.98  100  59  60.4  58.4  2.5  180  179  190  1.5  Bl'  HUB 

37  4397  1402  1404  1002  982  0.98  100  61  60.1  58.3  2.4  180  181  188  1.8  Bl'  HUB 

38  4400  140114011002  982  0.98  101  61  60.1  58.6  1.9  181  180  187  1.4  Bl'  HUB 

39  7338  2099   1  607  1689  2.78  84  60  40.8  31  9.8  181  238  0  0  CI"  TURBINE 

40  7377  2100   0  610  1686  2.76  84  57  41.4  34.4  7  181  241  0  0  CI"  TURBINE 

41  7615  2100   1  611  1688  2.76  85  59  40.8  33.8  7  178  238  0  0  CI"  TURBINE 

42  7616  2101   1  609  1694  2.78  83  60  40.8  33.8  7  179  240  0  0  CI"  TURBINE 

43  7666  2101   1  616  1687  2.74  82  57  40.8  33.9  6.9  180  243  0  0  CI"  TURBINE 

44  7692  2101   0  613  1704  2.78  84  57  40.8  33.4  7.4  179  237  0  0  CI"  TURBINE 

45  2209  2001   0  913  2363  2.59  94  59  50.9  45.7  5.2  172  252  0  0  C2'  SUPPORT 

46  2225  2001   1  919  2374  2.58  92  58  50.9  46.3  4.6  180  258  0  0  C2'  SUPPORT 

47  8876  2001  1499  286  324  1.13  66  41  22.3  22.3  0  180  192  0  0  Dl  STATOR 

48  8878  2001  1501  286  324  1.13  66  41  22.3  21.8  0.5  179  191  0  0  Dl  STATOR 

49  8883  1999  1499  286  325  1.13  67  41  22.3  21.8  0.5  180  192  0  0  Dl  STATOR 

50  8884  20011499  285  325  1.13  67  41  23.4  22.2  1.2  179  192  0  0  Dl  STATOR 

51  8886  1999  1501  285  322  1.13  66  41  23.4  22.3  1.1  180  191  0  0  Dl  STATOR 

52  8895  1999  1501  285  325  1.13  66  40  21.7  21.2  0.5  180  194  0  0  Dl  STATOR 

53  8896  20011500  285  325  1.13  66  41  22.3  21.2  1.1  178  191  0  0  Dl  STATOR 

54  74  2100   0  679  1481  2.18  75  40  40.3  38.2  2.1  180  250  0  0  El  CLUTCH 
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model  for  validation.   As  shown  in  the  conceptual  procedure  depicted 
in  Figure  9,  the  rules  can  be  generated  by  inductive  learning. 


Insert  Figures  8  &  9  Here 


Inductive  learning  can  be  defined  as  the  process  of  inferring  the 
description  of  a  decision — i.e.,  a  concept — based  on  the  description 
of  examples  for  that  concept.   In  our  case,  the  data  in  Figure  8  can 
be  used  as  such  "training  examples"  for  learning  diagnostic  rules. 

There  are  a  variety  of  computer  algorithms  developed  for  inductive 
learning  (Michalski  1983).   The  one  we  used  is  a  program  called  ACLS 
(Anologue  Concept  Learning  System)  which  is  in  the  ID3  family  described 
in  (Quinlan  1986). 

Inductive  learning  algorithms  such  as  ACLS  use  a  decision-theoretic 
approach  to  form  homogenous  clusters  of  the  given  set  of  objects  such 
that  objects  in  each  cluster  have  the  same  values  for  some  group  of 
attributes.   Each  example  (object)  is  represented  as  a  conjunction  of 
attribute  value  pairs.   The  induction  algorithm  takes  such  object 
descriptions  as  input  together  with  a  classification  label  for  each 
object,  and  returns  a  description  for  each  of  the  classification 
labels,  expressed  as  a  conjunction  of  attribute  value  pairs,  such  that 
the  attributes  in  the  classification  description  form  a  subset  of  the 
total  set  of  attributes  used  to  describe  each  object.   This  classifi- 
cation description  is  in  effect  a  generalized  description  of  all 
objects  in  the  example  set  that  were  tagged  with  the  same  label. 

In  our  application,  each  TC  test  (only  "failed"  TC's  are  considered) 
represents  one  object.   The  object  description  is  the  conjunction  of 
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FIGURE  9     The  Use  of  Inductive  Learning  for  Deriving  Diagnostic  Rules 
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the  test  parameter  and  observed  value  pairs  (thus  each  test  parameter 

is  an  attribute)  and  the  classification  is  the  location  of  fault  that 

was  determined  on  the  shop  floor.   ACLS  derives  a  classification  rule 

(a  generalized  description  for  each  location  of  fault  expressed  in 

terms  of  the  observed  values  for  a  subset  of  test  parameters)  which 

for  the  purposes  of  display  is  cast  in  the  form  of  a  decision  tree, 

branching  according  to  the  values  of  the  attributes. 

By  running  the  training  examples  shown  in  Figure  8  through  the 

inductive  learning  program  ACLS,  we  obtained  a  set  of  diagnostic 

rules;  some  of  the  sample  diagnostic  rules  are  illustrated  in  Figure 

10.   Consider,  for  example,  a  diagnostic  rule  R.  obtained  by  induction, 

of  the  following  form: 

Ri:   IF  (|T   -  a   I  >  e   )  &  (|T   -  a,  |  >  e   )  &  .  .  .  . 
^1     1      1       ^2    ^2      2 

....&(  |t   -  a   I  >  e   ) 
k    ^k     ^k 

THEN   Fault-Location  is  i 

The  validation  of  the  model  using  this  rule  would  proceed  as  below: 

STEP  1   Introduce  a  qualitative  deviation  d  to  the  flow  at  the  exit 

of  the  component/conduit  associated  with  location  i. 

For  d  =  [+]  and  [-]  respectively,  do  Step  2  and  Step  3. 
STEP  2   Propagate  the  deviation  through  the  schematic  using  the 

behavioral  rules  of  the  components/conduits  that  lie  in  the 

causal  path;  determine  the  values  predicted  for  the  set  of 

test  parameters  JT.,  i=l,...,n}. 
STEP  3   Compare  the  predicted  test  values  obtained  in  Step  2  with  the 

values  specified  in  the  antecedent  of  R . .   If  the  two  sets 
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of  conditions  match,  then  R,  is  consistent  with  the  qualita- 
tive model.   Exit. 
STEP  4   Otherwise  R.  is  not  consistent  with  the  qualitative  model,  a 
modification  routine  is  called  upon  to  check  the  source  of 
the  discrepancies. 
To  illustrate  the  validation  process  consider  the  following  rule: 
IF    (Input-Torque  (IT)  =  [-])  and  (Inlet-Flow  (IFLOW)  =  [+]) 

and  (Output-Torque  (OT)  =  [+] )  and  (Input-Speed  (IRPM)  =  [-]) 
THEN   Fault-Location  is  IMPELLER 
(In  terras  of  the  TC  schematic  these  test  parameter  symbols  translate 

as:   IT  =  T, ,  IFLOW  =V.    ,OT=T  ^   ^   o    ^   ^^PM  =  V.  ) 
i*  in,t*       out,0s2  is 

The  validation  of  the  model  would  appear  as  below: 

STEP  1   The  system  introduces  a  [+]  deviation  to  the  flow  at  the  exit 

of  the  IMPELLER.   Thus  it  sets  V    ,=[+]. 

out,i 

STEP  2   Propagating  this  through  the  schematic  yields  the  following: 

(11)  (V^„^^  -  [^1} >  (V^^^^^  =  M]    and  {T^^^^^  -  M]    by 

rule  3  of  TURBINE 

^^^^>  l^out,t  =  f^n >  {^out,h  =  f^n  ^y  ^^1^  3  °^  «"» 

^^^^  {^out,h  =  f^n >  {Tout,0s2  =  f^n  ^y  ^^^^  ^  ^^  °"^P"^  ^"^^ 

^^>  {^ut.t  =  t^H >  l^in,st  =  t^^}  ^y  ^^^^  '   °^  ^2 

(vl)  {V-    ^  =  [+]}  >  IV   ^   ^  =  [+]}  and  It   ^   ^  =  [+])  by 

I  in, St      >  I  out, St      J      I  out, St      J   -^ 

rule  3  of  STATOR 

^^^^>  {^ut,st  =  ^^^} >  t^in,i  =  f^n  t>y  rule  4  of  C3 

(viii)  |V,   ,  =  [+]}  >  JT   ^  ,   =1-]}  by  rule  3  of  IMPELLER 

I  in,i      J       I  out, ha      J   -^ 
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Diagnostic  Rules 

(1)  IF   (INPUT-RPM  <  1552)  &  (INPUT-TORQUE  <  749) 
THEN    (FAULT-LOCATION  IS  SHAFT) 

(2)  IF  (INPUT-RPM  <  1552)  &  (INPUT-TORQUE  >=  749)  &  (OUTPUT-TORQUE  <  985) 
THEN    (FAULT-LOCATION  IS  HUB) 

(3)  IF  (INPUT-RPM  <  1552)  &  (INPUT-TORQUE  >=  749)  &  (OUTPUT-TORQUE  >=  985) 
THEN    (FAULT-LOCATION  IS  CARRIER  ASSEMBLY) 


(4)   IF  (INPUT-RPM  >=  1552)  &  (LEAKAGE  >=  3.8)  &  (OUTPUT-TORQUE  >=  1664) 
THEN    (FAULT-LOCATION  IS  TURBINE) 


(5)  IF  (INPUT-RPM  >=  1552)  &  (LEAKAGE  >=  3.8)  &  (OUTPUT-TORQUE  <  1664) 
THEN    (FAULT-LOCATION  IS  CARRIER) 


(6)   IF   (INPUT-RPM  >=  1552)  &  (LEAKAGE  <  3.8)  &  (OUTPUT-RPM  >=  750) 
THEN    (FAULT-LOCATION  IS  STATOR) 


(7)   IF  (INPUT-RPM  >=  1552)  &  (LEAKAGE  <  3.8)  &  (OUTPUT-RPM  <  750) 
THEN    (FAULT-LOCATION  IS  IMPELLER) 


FIGURE  10  (b)     Sample  Diagnostic  Rules  Learned  from  the  Empirical  Data 
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(Ix)  (T  ^  ^  =  [-]}  >  (T  ^  ,   =  [-]}  by  rule  2  of  HOUSING 

I  out, ha      '  ^    out, is      J  -^ 

ASSEMBLY 

(x)  (T^  =  [-]}  and  {V^^  =  [-]}  >  [T^^^^^^   =  [-]}  by  rule  2  of 

INPUT  SHAFT 
Thus  the  [+]  deviation  at  IMPELLER  exit  has  predicted 

(^n,t  "  f^n  by  (ii) 

(^out,0s2  =  f-n  by  (iv) 

(T^  =  [-]}  and  (V^g  =  [-]}  by  (x) 
STEP  3   Comparing  these  predicted  values  with  the  antecedent  of 

induction  rule  R.  yields  a  perfect  match.   Thus  the  system 
concludes  that  the  induction  rule  R.  is  consistent  with  the 
qualitative  model* 

In  the  event  of  a  perfect  match  not  being  obtained,  intervention 
by  a  domain  expert  is  required  to  reconcile  the  discrepancies  between 
predicted  and  observed  values  for  the  test  parameters  in  question. 
The  expert  must  make  a  judgment  about  the  validity  of  the  data  used  to 
induce  the  rules  on  the  one  hand  (data  may  have  been  corrupted  by 
noise),  and  the  validity  of  the  qualitative  model  on  the  other.   As 
shown  in  Figure  9,  this  reconciliation  between  the  deep  reasoning  of 
the  model  and  the  shallow  reasoning  represented  by  induction  rules  is 
brought  about  by  comparing  the  predictions  made  by  each  with  the 
expert's  own  heuristics. 


Insert  Figure  10  Here 


In  a  sense,  the  inductive  learning  process  can  be  viewed  as  data 
compression  since  the  rules  derived  contain  all  the  relevant  knowledge 
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described  by  the  training  examples.   We  can  then  use  these  rules  to 
validate  the  qualitative  causal  model.   Besides  serving  as  a  valida- 
tion tool  during  the  initial  model  building  stage,  induction  can  be 
useful  in  carrying  out  periodic  reviews  of  the  model,  modifying  its 
behavioral  rules  when  necessary. 

7.   Summary 

We  have  shown  how  fault  diagnosis  of  a  mechanical  assembly  can  be 
performed  using  a  qualitative  reasoning  model  representing  the  mecha- 
nism of  the  assembly.   Starting  with  the  classification  of  the 
assembly's  parts  into  two  generic  types  called  components  and  con- 
duits, a  structural  description  consisting  of  a  schematic,  which  is  a 
circuit  diagram-like  representation  of  the  interconnections  between 
parts,  and  the  variables  that  characterize  the  parts,  is  built.   A 
description  of  the  assembly's  behavior  is  contianed  in  a  set  of  behav- 
ioral rules  (derived  from  the  quantitative  equations  that  describe  the 
physical  system),  that  specify  mapping  of  the  entrance  value  of 
"material  flow  variables"  to  their  exit  values.   The  physical  system's 
behavior  is  simulated  by  a  causal  reasoning  approach  that  uses  these 
behavioral  rules  to  determine  the  effects  that  are  passed  between  the 
system's  elements.   Induction  is  used  as  a  mechanism  for  abstracting 
generalizations  from  raw  performance  data,  which  is  then  used  to  vali- 
date the  qualitative  causal  reasoning  model  as  well  as  the  domain 
expert's  diagnostic  heuristics. 

Although  the  qualitative  reasoning  approach  with  causal  models  is 
applied  only  to  the  fault  diagnosis  in  this  paper,  the  approach  has 
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broader  implications  to  integrated  manufacturing.   Using  the  manufac- 
turing of  torque  converter  as  an  example,  the  causal  model  for  the 
assembly  can  be  used  by  the  design  engineer  to  test  if  the  underlying 
design  for  the  torque  converter  assembly  meets  the  functional  specifi- 
cations (Murakami  and  Nakajima  [1988]);  the  process  engineer  can  use 
the  model  of  the  assembly  for  process  planning  (Shaw,  Menon,  and  Park 
[1988]);  and  the  quality  control  engineer  can  use  it  for  fault  diag- 
nosis as  described  in  this  paper.   Such  an  approach  unifies  the  repre- 
sentation of  the  assembly  in  different  phases  of  the  manufacturing 
process  and  enforces  the  coordination  among  these  manufacturing  activ- 
ities. 

Acknowledgement 

This  research  is  supported  by  the  Office  for  Information  Manage- 
ment, the  Research  Board  of  the  University  of  Illinois,  Texas 
Instruments,  and  IntelliCorp.   Texas  Instruments  and  IntelliCorp  also 
provided  the  LISP  machine  and  the  knowledge  engineering  environment 
(KEE)  software  for  implementing  the  prototype.   Thanks  are  due  to 
Caterpillar  Tractor  Company  for  access  to  their  QMS  database  and  the 
many  hours  their  diagnostic  experts  in  the  Transmission  Division 
devoted  to  this  project.   The  help  we  obtained  from  the  Quality 
Control  Department  there  are  greatly  appreciated. 

References 


Becker,  L.  A.  and  Bartlett,  R. ,  (1988).   Compiling  Diagnostic  Rules 
from  a  Manufacturing  Process  Representation,  in  Artificial 
Intelligence  in  Engineering:   Diagnosis  and  Learning,  J.  S.  Gero 
(Ed.),  Elsevier,  Amsterdam,  pp.  285-304. 


-39- 


Bobrow,  D.  G.,  (1985).   Qualitative  Reasoning  About  Physical  Systems 
(Ed.),  MIT  Press,  Cambridge,  MA. 

Davis,  R. ,  (1983).   Qualitative  Reasoning.   In  Qualitative  Reasoning 
About  Physical  Systems,  D.  Bobrow  (Ed.),  MIT  Press. 

De  Kleer,  J.  and  Brown,  J.  S.,  (1982).   Foundations  of  Envisioning, 
Proc.  Nat'l  Conf.  on  Artificial  Intelligence,  pp.  434-437. 

De  Kleer,  J.  and  Brown,  J.  S.,  (1985).   Qualitative  Physics  Based  On 
Confluences.   In  Qualitative  Reasoning  About  Physical  Systems, 
D.  Bobrow  (Ed.),  MIT  Press. 

Fink,  P.  K.  and  Lusth,  J.  C,  (1987).   Expert  Systems  and  Diagnostic 
Expertise  in  the  Mechanical  and  Electrical  Domains,  IEEE  Trans- 
actions on  Systems,  Man,  and  Cybernetics,  V.  17,  No.  3,  pp.  340-349 

Forbus,  K.  D.,  (1985).   Qualitative  Process  Theory,  Artificial 
Intelligence,  V.  24. 

Genesereth,  M.  R.,  (1985).   The  Use  of  Design  Descriptions  in  Auto- 
mated Diagnosis,  Artificial  Intelligence,  V.  24. 

Garvin,  D.  A.,  (1988).   Managing  Quality,  Macmillan  Publishers, 
New  York. 


Groover,  M.  P.,  (1980).   Automation,  Production  Systems,  and  Computer- 
Aided  Manufacturing,  Prentice-Hall  Inc.,  Englewood  Cliffs,  N.J. 

Iwasaki,  Y.  and  Simon,  H.  A.,  (1986).   Causality  in  Device  Behavior, 
Artificial  Intelligence,  V.  29. 

Kuipers,  B.,  (1985).   Commerce  Sense  Reasoning  About  Causality: 

Deriving  Behavior  from  Structure,  Artificial  Intelligence,  V.  24. 

Kuipers,  B. ,  (1986).   Qualitative  Simulation,  Artificial  Intelligence, 
V.  29,  pp.  289-338. 

Larew,  W.  B.,  (1968).   Fluid  Clutches  and  Torque  Convertors.   Chilton 
Book  Company. 

Larkin,  J.,  McDerraott,  J.,  Simon,  D.  and  Simon,  H. ,  (1980).   Expert 
and  Novice  Performance  in  Solving  Physics  Problems,  Sciences, 
V.  208,  pp.  1335-1342. 

Murakami,  T.  and  Nakajima,  (1988).   Computer-Aided  Deign  Diagnosis 
Using  Feature  Description,  in  Artificial  Intelligence  in 
Engineering;   Diagnosis  and  Learning,  J.  S.  Gero  (Ed.),  Elsevier, 
Amsterdam,  pp.  199-226. 


-40- 


Michalski,  R.  S.,  (1983).   A  Theory  and  Methodology  of  Inductive 

Learning,  in  Machine  Learning,  Michalski,  Carbonell,  and  Mitchell 
(eds.),  Tioga  Publishing  Co.,  Palo  Alto,  CA. 

Quinlan,  J.  R. ,  (1979).   Discovering  Rules  from  Large  Collections  of 
Examples:   A  Case  Study.   In  Expert  Systems  in  the  Microelectronic 
Age,  D.  Mitchie  (Ed.),  Edinburgh  University  Press. 

Quinlan,  J.  R. ,  (1986).   Induction  of  Decision  Trees.   In  Machine 
Learning,  Vol.  1,  pp.  81-106,  1986. 

Ranky,  P.  G.,  (1986).   Computer-Integrated  Manufacturing,  Prentice- 
Hall  International,  Englewood  Cliffs,  N.J. 

Reiter,  R. ,  (1987).   A  Theory  of  Diagnosis  From  First  Principles, 
Artificial  Intelligence,  V.  32  (1),  pp.  57-96. 

Rieger,  C.  and  Grinberg,  M. ,  (1978).   A  System  of  Cause-Effect  Repre- 
sentation and  Simulation  for  Computer-Aided  Design,  in  Artificial 
Intelligence  and  Pattern  Recognition  in  Computer  Aided  Design, 
Latombe  (ed.),  North-Holland  Pub.  Co.,  Amsterdam,  pp.  299-334. 

Shaw,  M. ,  Menon,  U.,  and  Park,  S.C.,  (1988).   An  Explanation-Based 
Learning  Approach  to  Intelligent  Process  Planning,  in  Expert 
Systems  for  Manufacturing  Designs,  A.  Kusiak  (Ed.),  Society  of 
Manufacturing  Engineers  Press,  Dearborn,  MI. 


D/259A 


I 


APPENDIX  A  -   QUALITATIVE  REASONING  PROCESS 

STEP  1;   BUILD  DEPENDENCY  LISTS* 

i)   Identify  the  set  of  elements  |E  }  that  have  been  known  to 

cause  a  device  malfunction 
ii)   For  each  E.  introduce  a  [+]  deviation  for  material  flow 

variable  Mv  at  this  element's  exit 
iii)  Propagate  this  deviation  through  the  schematic,  following  the 

path  of  Mv  ,  updating  the  qualitative  values  of  material  flow 

variables  at  the  inlet  and  exit  points  of  all  elements  in  the 

scheamtic 
iv)   Form  a  list  L.   of  all  test  parameters  (subset  of  material 


flow  variables)  whose  values  show  [+]  deviation  and  list  L 


i- 


for  all  test  parameters  that  show  [-]  deviation 
v)   Repeat  steps  (ii)-(iv)  with  [-]  deviation  for  Mv  and  update 
lists  L   &  L 

vi)   From  the  lists  L   and  L._,  compile  dependency  lists  D   and 
D.   for  the  i    test  parameter  such  that  D.,  contains  all 
those  elements  that  caused  a  [+]  deviation  in  j's  value,  and 
D.__  contains  those  elements  that  caused  a  [-]  deviation  in 
j's  value.  Repeat  this  V  . 
*This  is  a  one  time  activity  that  helps  save  diagnosis  each  time. 


STEP  2:   HYPOTHESIS  GENERATION 


i)   Given  an  observed  set  of  test  parameter  values  {O,},  retrieve 
the  corresponding  dependency  list  for  each  0.  that  has  a  [+] 
or  [-]  value. 


A- 2 

ii)   Form  a  candidate  element  list  |C  }  above  that  is  the  inter- 
section of  all  dependency  lists  in  (i)  above.   This  is  the 
list  of  likely  sources  of  device  malfunction. 

STEP  3;   ENVISIONMENT 

i)   For  each  candidate  element  in  {C.},  introduce  a  deviation  for 
material  flow  variable  at  exit  of  element  and  propagate  this 
through  the  schematic  updating  all  material  flow  variables. 
Compare  the  predicted  values  of  test  parameters  with  (O.l. 
If  a  perfect  match  is  obtained,  this  element  is  confirmed  as 
a  source  of  device  malfunction  otherwise  this  element  is 
removed  from  the  list  {C.l. 

ii)  Return  the  element  remaining  in  {C.}  after  (i)  and  terminate 
procedure. 

iii)  If  after  (i)  |C  }  has  no  elements,  start  with  each  of  the 
remaining  elements  not  in  {E,}  and  propagate  deviations 
introduced  at  the  exit  of  the  element  updating  material  flow 
variables  as  before.   Compare  predicted  test  parameter  values 
with  {O.j  and  stop  when  a  perfect  match  is  found. 


** 


**The  system  could  be  directed  to  search  the  remaining  elements  in 
some  prespecified  order  so  that  it  works  its  way  down  the  list 
beginning  with  the  most  probable  element. 


APPENDIX  B  -  THE  TORQUE  CONVERTER 

The  torque  converter  is  a  device  used  in  automobile  transmissions. 
Its  function  is  similar  to  that  of  a  gear-box  in  conventional  trans- 
missions; it  takes  the  engine  torque  as  input  and  delivers  a  higher 
torque  as  output  to  the  propeller  shaft.   Ignoring  losses  in  trans- 
mission, it  transfers  the  power  generated  by  the  engine,  unchanged  to 
the  wheels  of  the  vehicle,  but  at  an  increased  torque  level. 

power  =  torque  x  rpm 
Since  power  transmitted  remains  the  same,  an  increase  in  torque  implies 
that  the  rotational  speed  (rpm)  must  decrease  proportionately.   When 
the  vehicle  starts  from  rest,  its  wheels  are  stationary,  i.e.,  rpm  =  0. 
Initial  torque  required  to  move  the  vehicle  from  rest  is  high,  with  a 
steady  reduction  in  torque  requirement  as  the  vehicle  picks  up  momentum. 
In  contrast  to  this  desired  profile,  the  engine  is  running  at  a  constant 
rpm  (the  optimum  speed  specified  for  maximum  efficiency),  and  thereby 
producing  a  constant  torque.   The  torque  converter  acts  as  an  interface 
between  the  engine  and  the  rest  of  the  power  transmission  unit,  facili- 
tating generation  of  maximum  power  by  the  engine  at  constant  rpm  (and 
thereby  constant  torque)  while  providing  a  varying  torque  as  dictated 
by  the  vehicle's  dynamics. 

The  principal  elements  of  a  torque  converter  include  an  input 
shaft,  impeller,  turbine,  stator,  and  output  shaft.   Figure  B-1  is  the 
engineering  drawing  of  the  torque  converter.   Power  is  transmitted 
from  the  engine  to  the  input  shaft  which  is  directly  coupled  and  thus 
rotating  at  the  same  speed  (rpm).   The  impeller,  which  has  a  fan-like 
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construction  composed  of  several  vanes  that  project  radially  outward 
from  a  core,  is  fixed  to  the  input  shaft  and  therefore  rotates  at  the 
same  speed.   The  outer  ends  of  the  radially  projecting  vanes  are 
attached  to  a  shell  which  together  with  the  core  divide  the  space 
within  them  into  compartments  resembling  distorted  doughnuts.   The 
turbine  resembles  the  impeller  except  for  the  curvature  of  its  vanes. 
The  turbine  core  is  fixed  to  a  hub  mounted  on  the  output  shaft.   The 
impeller  and  turbine  are  enclosed  in  a  housing  containing  fluid. 
Wedged  between  the  turbine  and  impeller  is  the  stator  which  is  similar 
to  them  in  construction. 


Insert  Figure  B-1  Here 


When  the  impeller  attached  to  the  input  shaft  rotates,  it  sets  the 
fluid  inside  the  housing  in  rotation  with  it.   Centrifugal  forces  act- 
ing on  this  rotating  fluid  cause  it  to  move  from  the  core  (which  is  at 
a  radially  smaller  distance  from  the  axis  of  rotation  of  the  shaft) 
towards  the  shell.   Thus  the  velocity  of  the  fluid  particles  has  two 
components;  a  tangential  component  provided  by  the  impeller  vanes 
causing  the  fluid  to  rotate  with  them,  and  a  radial  component  imparted 
by  the  centrifugal  forces  causing  the  fluid  to  move  along  the  length 
of  the  vane  from  core  to  shell.   Having  reached  the  (radially)  outer- 
most point  along  the  vane,  the  fluid  particles  are  prevented  from  any 
further  displacement  radially  by  the  shell.   This  causes  them  to  enter 
the  spaces  between  the  vanes  of  the  turbine,  driving  the  (initially) 
stationary  fluid  there  radially  inward  towards  the  core.   This  sets  up 
a  circulatory  flow  in  a  plane  perpendicular  to  the  plane  of  rotation 
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of  the  impeller.   The  curvature  of  the  turbine  vanes  changes  the  direc- 
tion of  circulatory  flow  so  that  fluid  particles  leaving  the  turbine 
vanes  (at  a  radial  distance  near  the  core)  now  flow  toward  the  impeller. 
This  change  in  velocity  produces  a  reaction  on  the  turbine  vanes, 
forcing  them  to  rotate  in  the  same  direction  as  the  impeller.   Before 
the  fluid  particles  re-enter  the  impeller  vane  passages,  they  pass 
through  the  spaces  between  the  stator  vanes.   Since  the  stator  is 
mounted  on  a  fixed  shaft  (it  does  not  rotate  unlike  the  turbine  and 
impeller),  it  reduces  the  rotational  component  of  the  fluid  particles 
to  zero,  thus  leaving  them  with  only  a  circulatory  flow  component  as 
they  re-enter  the  impeller.   The  impeller  vanes  again  impart  a  rota- 
tional velocity  component  to  the  entering  particles  and  a  new  (cir- 
culatory) cycle  begins. 

With  every  circulatory  cycle  of  fluid  flow  energy  is  transmitted 
from  the  impeller  to  the  turbine  which  in  turn  drives  the  output  shaft. 
The  difference  in  rotational  speeds  between  the  impeller  and  turbine 
is  proportional  to  the  percentage  increase  of  output  torque  over  input 
torque.   As  the  output  shaft  picks  up  speed  (the  vehicle  gaining  in 
momentum)  the  difference  between  input  and  output  shaft  speeds  de- 
creases, reducing  the  output  to  input  torque  ratio,  until  it  reaches  a 
ratio  of  one.   This  corresponds  to  directly  coupling  the  two  shafts, 
bypassing  the  torque  converter.   This  is  achieved  by  a  clutch,  a  detail 
that  we  need  not  concern  ourselves  with  in  this  paper  beyond  noting  its 
presence  as  one  element  in  the  torque  converter  assembly. 


APPENDIX  C  -  SAMPLE  DISPLAYS  OF  THE  EXPERT  SYSTEM  PROTOTYPE 


Test  for  stall  input  torque  high  with  large  difference 


Consultation  for:   CATERPILLAR:  TORQUE  CONVERTER  DECISION  SYSTEM' 


"the  test  results  for  input  torque,  1. 

"the  input  torque  at  STALL 

"the  torque  ratio  at  STALL 

"the  leakage  at  STALL 

"the  tests  for  input  torque,  efficien. 

"the  tests  for  input  torque,  efficien. 

"the  test  for  effeciency  and  leakage  . 


YES" 

1200" 

unknown" 

unknown" 

NO" 

NO" 

NO" 


TORQUE-CONVERTER- 1   CONCLUSIONS: 

The  name  of  the  part  which  could  be  causing  the  failure  is  as 

follows: 

IMPELLER   (75%)   STATOR   (25%) 

Test  for  stall  input  torque  high  with  small  difference 


Consultation  for:   CATERPILLAR:  TORQUE  C0^4VERTER  DECISION  SYSTEM' 


"the  test  results  for  input  torque,  1. 

"the  input  torque  at  STALL 

"the  torque  ratio  at  STALL 

"the  leakage  at  STALL 

"the  tests  for  input  torque,  efficien. 

"the  tests  for  input  torque,  efficien. 

"the  test  for  effeciency  and  leakage  . 


YES" 

1080" 

unknown" 

unknown" 

NO" 

NO" 

NO" 


TORQUE-CONVERTER- 1   CONCLUSIONS: 

The  name  of  the  part  which  could  be  causing  the  failure  is  as 

follows : 

IMPELLER  CF  (8%)   HOUSING  CF  (8%)   BEARING  CF  (8%)   CARRIER   (75%) 


APPENDIX  C  -  SAMPLE  DISPLAYS  OF  THE  EXPERT  SYSTEM  PROTOTYPE 


Test  for  stall  input  torque  low  with  large  difference 


Consultation  for:   CATERPILLAR:  TORQUE  CONVERTER  DECISION  SYSTEM 


"the  test  results  for  input  torque,  1 

"the  input  torque  at  STALL 

"the  torque  ratio  at  STALL 

"the  leakage  at  STALL 

"the  tests  for  input  torque,  efficien 

"the  tests  for  input  torque,  efficien 

"the  test  for  effeciency  and  leakage 


YES" 

800" 

unknown' 

unknown' 

NO" 

NO" 

NO" 


TORQUE-CONVERTER- 1   CONCLUSIONS: 

The  name  of  the  part  which  could  be  causing  the  failure  is  as 

follows: 

IMPELLER   (75%)   STATOR   (25%) 

Test  for  stall  input  torque  low  with  small  difference 


Consultation  for:   CATERPILLAR:  TORQUE  CONVERTER  DECISION  SYSTEM 

"the  test  results  for  input  torque,  1...  ::  YES" 

"the  input  torque  at  STALL  '  :  :  950" 

"the  torque  ratio  at  STALL  : :  unknown" 

"the  leakage  at  STALL  :  :  unknown" 

"the  tests  for  input  torque,  efficien...  ::  NO" 

"the  tests  for  input  torque,  efficien...  ::  NO" 

"the  test  for  effeciency  and  leakage  ...  : :  NO" 


TORQUE-CONVERTER- 1   CONCLUSIONS: 

The  name  of  the  part  which  could  be  causing  the  failure  is  as 

follows:   Inlet  or  outlet  oil  flow  problems  -  blocked  passage 


